On Entropy Minimization and Convergence

Simulated Entropy and Global Minimization

ABSTRACT: Non-linear programming deals with the problem of optimizing an objective function in the presence of equality and inequality constraints. Most of the classical deterministic methods encounter two major problems: (i) the solution obtained is heavily dependent on the starting solution: and (ii) the methods often converge to inferior local optima. This paper examines the relationship bet...

Minimization of entropy functionals

Entropy functionals (i.e. convex integral functionals) and extensions of these functionals are minimized on convex sets. This paper is aimed at reducing as much as possible the assumptions on the constraint set. Dual equalities and characterizations of the minimizers are obtained with weak constraint qualifications.

On convergence properties of Shannon entropy

Convergence properties of Shannon Entropy are studied. In the differential setting, it is shown that weak convergence of probability measures, or convergence in distribution, is not enough for convergence of the associated differential entropies. A general result for the desired differential entropy convergence is provided, taking into account both compactly and uncompactly supported densities....

Comparison of entropy generation minimization principle and entransy theory in optimal design of thermal systems

In this study, the relationship among the concepts of entropy generation rate, entransy theory, and generalized thermal resistance to the optimal design of thermal systems is discussed. The equations of entropy and entransy rates are compared and their implications for optimization of conductive heat transfer are analyzed. The theoretical analyses show that based on entropy generation minimizat...

Properties of cross-entropy minimization